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(S) Method and apparatus for adaptive color characterization and calibration. 

(57) A system and a method in which channel independent linear transfer functions or calibration curves 
for color devices such as printers, scanners and displays are individually created using a low cost a light 
intensity sensor. Scaling constants are determined and desired linear aim response curves are scaled 
together to maintain a desired color balance. The color saturation effects are also removed by scaling or 
normalizing to some maximum input drive level that does not saturate any of the colors. The 
characterization curves are rotated about the desired linear aim response curves to create compens- 
ation curves for each the characterization curves adapted to the particular device response character- 
istics. The dynamic range maximized, linearized, color balanced and saturation compensation curves 
are loaded into conversion tables which convert input values into the appropriate output values. 
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Cross References To Relat d Applications 

The present application is related to U.S. applications : Subtractrve M asurement Method And Apparatus 
For CRT Output Intensity Measurement having U.S. Serial No. 855, 400 filed on March 23, 1992, Luminance 
5 Measurement Method And Apparatus having U.S. Serial No. 855,281 , filed on March 23, 1 992, CRT Calibrator 
Unit having U.S. Serial No. 855,260 filed on March 23, 1992 and A Method And Apparatus For Automatically 
Calibrating A CRT Display EP-A-921 16420.6 are incorporated by reference herein. 

BACKGROUND OF THE INVENTION 

10 

Field of the Invention 

The present invention is directed to a method and apparatus for adaptively characterizing and calibrating 
color document scanners, color display units and color printers and, more particularly, to providing unique a 
15 calibration transform for each device using a low cost achromatic sensor and which minimizes device popula- 
tion variance by providing a method, executable by the user of a color management system, producing con- 
strained channel independent linearization, aim or target curve scaling to achieve a desired color balance and 
aim curve scaling for channel saturation correction. 

20 Description of the Related Art 

In desk top (low cost) color image processing or management systems which include peripheral devices, 
such as document scanners, color cathode ray tube monitors or displays and color printers, consistent color 
appearance matching between peripheral devices is necessary. Precise color rendering throughout such sys- 

25 terns relies on the color stability, consistency and accuracy of the peripheral devices. 

Calibration is an integral part of a low cost color management system. Numerous manufacturers market 
devices and/or software packages which addresses the peripheral calibration requirement with various levels 
of calibration accuracy. A majority of these solutions are limited to monochrome calibration for cost reasons, 
and thus are not as accurate as those products incorporating full colorimetric measurement and correction. It 

30 is generally though erroneously felt that monochrome calibration is sufficient for the desk top environment. 

For scanner calibration, Savitar, markets two solutions aimed at the high and low end markets, respec- 
tively. The high-end solution, sold under the name SpectraPlate/35, utilizes a numerical analysis package in 
conjunction with a target containing a linear variable spectral filter and a neutral density gray ramp. The neutral 
density ramp is used to measure and correct tone scale deficiencies. This ramp exhibits constant transmission 

35 characteristics across the visible spectrum and varies linearly by two orders of magnitude in transmission from 
D-min to D-max. The linear variable filter is utilized to balance the scanner's red, green and blue (RGB) chan- 
nels to neutral gray across the entire dynamic range of the device. It functions as an interference wedge that 
spectrally separates the scanner's illumination system into a continuous distribution (in a manner similar to a 
prism) which is then imaged onto a charge coupled device (CCD) imager. Fiducial marks on the target permits 

ao correlation of pixel data to wavelength. This enables the scanner to obtain its spectral response without ex- 
ternal instrumentation. Savitar's low end product, ScanMatch, utilizes a 24 patch colorimetric target as a ref- 
erence, thus enabling accurate colorimetric calibration with in target tolerance. Under this approach, the target 
is scanned by the device to be calibrated using either the ScanMatch application or some other program con- 
taining the appropriate device drivers. The resulting digital data file is processed by the ScanMatch, application 

45 where data extraction and transform generation occurs. Transform table construction is simply performed by 
building a model linking scanned data to previously defined reference data that was derived from the target. 

Vendors such as RasterOps, Radius, SuperMac and Barco market closed-looped monitor calibration pack- 
ages which include various combinations of instrumentation (typically a colorimeter), signal correction elec- 
tronics and control software for automated data acquisition and numerical analysis. Those systems contain or 

so are capable of supporting colorimeters to provide color balance calibration by modifying look-up tables or a 
color correction matrix. Colorimetric calibration yields optimal results, but is excessively cost prohibitive, there- 
fore, is usually instituted on high end systems. Those packages that do not support this calibration assume a 
nominal phosphor characteristic in their correction matrix. 

The Radius and SuperMac Technology's SuperMatch products provide a low nd solution limited to mono- 

55 chrome calibration. Both packages, which are ess ntially similar, contain a control and numerical analysis ap- 
plication and a measurement device for gun response m asurements. Th se two solutions generate num rous 
test patches along the primary seal s which are subsequ ntly measur d to ascertain the independent gun re- 
sponse. Alook-up table for each gun is calculated which appropriately distorts incoming data to overcome chan- 
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nel irregularities to form some pr determined, idealized response. This process is generally referred to as 
"gamma'' correction since it negates the monitor's characteristic gamma response, but the proper idealized 
response could help overcome systems problems such as flair, surround effect, tc. Both products also permit 
user selection of monitor white point which is accomplished by selecting the desired correlated color temper- 
5 ature and monitor type. Prestored phosphor chromaticity data for each monitor type is utilized to adjust the 
gamma correction curves to achieve the desired color balance. Obviously, this colorimetric calibration method 
is inferior when compared to others since device measurements are not performed on each device, instead 
they are made at the factory on a limited population. 

If more exacting colorimetric calibration is required, each device must be measured independently using 

w a colorimeter or spectralradiometer. The RasterOps CorrectColor Calibrator product serves this market by pro- 
viding an integrated colorimeter with a supporting control/numerical analysis software package. This system 
supports user defined gamma correction and color temperature adjustments as outlined above, but uses meas- 
ured phosphor chromaticity values rather than a factory standard default The overall colorimetric calibration 
accuracy is then limited by measurement precision. 

15 Printer calibration also utilizes a measurement device (usually a densitometer, colorimeter with a source 

or a spectrophotometer) and a software package to perform data generation and numerical analysis. The typ- 
ical calibration procedure includes printing a standardized target containing tone and/or gray scales followed 
by patch measurement and data insertion into the software (usually automated). Some systems utilize visual 
matching methods in place of instrumentation which undoubtedly causes higher levels of measurement error 

20 as compared with other forms of instrumentation. Numerical analysis is then performed to generate channel 
independent look-up tables which correct for non-idealized printing characteristics. The exact target charac- 
teristic response is a function of the package and is defined linearly with respect to dot gain or in terms of a 
D-iog E curve. This procedure is followed on both 3 and 4 color printers. The 4 color or "black" printer presents 
a special problem since the manufacturer has optimized the printing process by adding a black component in 

25 place of varying amounts ofCMY (Cyan, Magenta, Yellow). These UCR (Under Color Removal) and GCR (Gray 
Component Replacement) algorithms are generally different for each device type and are considered propri- 
etary knowledge of the print engine manufacturer. This information is not readily disseminated which forces 
the calibration system to compromise for a particular device to support all such devices. 

Attempts to market low-end printer calibration tools have been limited at this point because of instrumen- 

30 tation cost and the recent emergence of consumer grade color printers. A need for higher accuracy rendering 
is just starting to emerge, thus product development efforts have not matured. Eastman Kodak Co. currently 
sells a calibration package to linearize a QMS (Color Script 100) printer from densitometer measurements of 
the tone and gray scales. 

35 SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a calibration method which minimizes device population 
variance. 

It is another object of the present invention to characterize and calibrate devices in different classes, such 
40 as scanners, printers and displays, using the same method. 

It is also an object of the present invention to calibrate to a desired aim or target curve. 

It is still another object of the present invention to provide a calibration system that uses a low cost ach- 
romatic photometer light sensor that senses intensity and is nonphotopic. 

It is a further object of the present invention to provide a transform that is universally applicable to devices 
45 in the same class. 

It is an object of the present invention to provide a system that simultaneously corrects for saturation ef- 
fects, linearizes device response, balances color response and scales device response to utilize the entire dy- 
namic range of the device. 

It is an additional object of the present invention to provide a system that independently corrects the color 
so channels by providing independent color correction curves which together are constrained to provide a color 
balanced response. 

It is a still further object of the present invention to provide a calibration system that can be periodically 
used by the user of a color reproduction system at the users job site after the color reproduction system has 
left the factory. 

55 The abov objects can be attained by a system and a method in which channel independent linear functions 

for device classes, such as printers, scanners and displays, are created to compensate for undesired tone scale 
b havior by requiring that the aim or target tone scale curves track or move together. A light int nsity sensor 
is used to separately measure color response curves. The curves are linearized separately and scaled together 
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to maintain a desired color balance. The color saturation effects are also removed by scaling to some maximum 
input drive level that does not saturate any of the colors and which maximizes the dynamic rang . The scaled, 
linearized, color balance and saturation compensation curves for each color are loaded into a conversion table 
which converts input into the appropriate output valu s for the device class. 
5 These together with other objects and advantages which will be subsequently apparent, reside in the de- 

tails of construction and operation as more fully hereinafter described and claimed, reference being had to the 
accompanying drawings forming a part hereof, wherein like numerals refer to like parts throughout. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates the transforms created by the present invention; 
Fig. 2 illustrates a correction operation; 
Fig. 3 depicts color balanced aim or target curves; 
Fig. 4 illustrates a saturated green primary; 

Fig. 5 illustrates rescaled balanced aim curves corrected for saturation; 
Fig. 6 illustrates the components of a system in accordance with the present invention; 
Fig. 7 illustrates a combined, tricolor aim curve for a scanner, 
Fig. 8 depicts a scanner target; 
Fig. 9 is a flowchart of the scanner calibration process; 
Fig. 10 depicts the process performed by the computer; 
Fig. 11 depicts balance operations; 
Fig. 12 depicts balanced aim curves; 
Fig. 13 illustrates a correction table in graphic form; 
Fig. 14 depicts monitor characteristics; 
Fig. 15 is a flowchart of a monitor calibration procedure; 
Fig. 16 is a flowchart of a computer processor for monitor calibration; 
Fig. 17 depicts balanced aim curves for a monitor; 
Fig. 18 depicts in graphic form a correction table for a monitor; 
Fig. 19 illustrates a typical printer response; 
Fig. 20 depicts a printer calibration process; 

Fig. 21 is a flowchart of a printer calibration process performed by a computer; 
Fig. 22 illustrates balanced aim curves for a printer; 
Fig. 23 is a correction table in graphic form for a printer. 

35 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention provides a calibration apparatus and method that minimizes device population va- 
riance when each device is individually calibrated by a user either at the factory or at the job site. This invention 
yields a unique calibration transform for each device that causes each device in a population to appear identical 
40 when digital data is passed through the transform. As an example, a scanned test target 1 0 scanned by a scan- 
ner 1 2 should generate identical responses through a calibration transform 14 and a characterization transform 
16 for all devices within a design tolerance, as illustrated in Fig. 1 . A set of transforms permits creation of a 
single statistically mean transform for each color that may be universally applied to all devices of a specified 
type (such as scanners). 

45 To guarantee consistent response at the calibration/characterization transform interface 14 and 16, adap- 
tive channel interdependent linearization is incorporated into the calibration process. Four key concepts are 
utilized concurrently in the present invention to incorporate such linearization: (1) constrained channel inde- 
pendent linearization, (2) aim or target curve scaling to achieve a specified color balance, (3) aim curve scaling 
to remove channel saturation effects and (4) aim curve scaling to utilize the entire dynamic range of the device. 

so Channel independent linearization is a technique similar to "gamma- correction for monitors where cor- 
rection functions are constructed to compensate for undesired tone scale behavior. The desired or target re- 
sponse is referred to as an "aim" curve and is defined in terms of device drive values to some traceable ref- 
erence color space metric, such as CIE (Commission International de I'Edairage) XYZ (tristimulus values) or 
L*A*B*. In th general case, this relationship is a linear function, hence the origin of the term "linearization," 

55 but it may tak on oth r forms which serve to minimize system quantization errors. As illustrat d in Fig. 2 for 
a device, a correction function 20 may be derived by simply rotating th actual d vice response about the aim 
curve when a linear response curve 24 is desired. It is evident that the part of th curve which could not be 
given by the rotation about the aim curve could be obtained on a point-by-point evaluation. Non-linear aim 
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curves require a more sophisticated evaluation method involving device modeling or point-by-point valuation 
such as that described in the automatic calibrating application previously mention d. 

The aim curve preferred for color management use is infinitely scaleable to permit utilization of full device 
dynamic range. Fixed aims are useful in some circumstances, but the typical computer peripheral has a limited 

5 dynamic range to begin with, so that even slight range compression could cause noticeable image contouring. 
Due to system requirements, the linearization metric needs to be a CIE traceable color space that operates 
on appropriately scaled data. Figure 3 illustrates cap Y from CIE tristimulus space for curves 30, 32 and 34 
defined as a linearization metric which is scaled to a white point by definition, thus meets the desired criteria. 
CIE L*A*B» or L*U*V* spaces are also usable spaces since they are also scaled to a white point. 

10 Normally, one aim is applied to all 3 or 4 device colorants simultaneously. This approach is generally suf- 
ficient for a fixed aim assuming the maximum device response exceeds the maximum aim requirements. Va- 
riable aims do not preserve a specific color balance and this is not acceptable. Full channel independence 
does not guarantee a known relationship between the colorants, and thus is not capable of compensating for 
degradations of a single colorant For example, this effect occurs quite frequently in monitors where emissivity 

15 of one gun falls with time which causes a color balance shift while preserving a relative tone scale. 

This problem may be overcome by appropriately constraining channel independent linearization such that 
the relative tone scales track. The preferred method involves scaling the 3 or 4 aims appropriately to achieve 
some sort of known color balance. The actual white point aim is not important in the general case provided it 
is achievable, robust and does not impact overall system accuracy. The color balance used by the present in- 

20 vention is preferably defined as a neutral gray under a D50 illuminant. 

Aim scaling is performed by utilizing an ideal additive (scanners and monitors) or subtractive (printers) color 
model as appropriate. A linear combination of the primaries can be found in either color system which satisfies 
the balance requirement given the knowledge of each primary's spectral characteristics. This function defines 
the required ratio of primaries across the entire gray scale which yields a true neutral to an excellent approx- 

25 imation for additive devices. Certain classes of printers, however, do not exactly adhere to the linear subtractive 
model due to ink laydown effects which cause some slight hue shading down the neutral scale. This effect is 
negated by the subsequent characterization step since a model is built of the calibration transform/device cas- 
cade and thus may be ignored. 

Since device to device variations exist in terms of dynamic range, minimum and maximum values, the con- 

30 cept of aim curve scaling may be applied to overcome these defects. Those regions where the linearization 
results depart from the aim are eliminated and scaling is applied to utilize the remaining device dynamic range. 
This situation commonly occurs on scanners and monitors when channel saturation is achieved and on printers 
as a particular colorant's maximum density degrades with time. Fig. 4 gives a graphic example of a green pri- 
mary 40 saturated at 90% full scale while the full scale is available for blue 42 and red 44. A rescaled color 

35 balanced aim as illustrated in Fig. 5 has a maximum input drive level of 90% full scale on all channels. As illu- 
strated, the red 50 and blue 52 aims have been truncated at their former 90% point matching the maximum 
saturation of the green aim 54 and which preserves neutrals at the cost of dynamic range. The ordinate has 
been rescaled such that 100% Y corresponds to blue at 90% rather than 100% and the balanced relationship 
of Fig. 3 has been maintained. 

40 A typical system in accordance with the present invention, as illustrated in Fig. 6, includes a computer 60, 
such as an IBM personal computer/system or an Apple Macintosh computer. The computer 60 can receive scan- 
ned documents from a scanner 62, such as 600ZS ScanMaker available from Microtek Lab, Inc. of Torrence, 
CA. To calibrate the scanner a predetermined test target document 64 is scanned. The output devices include 
a display 66, such as a CRT display or a liquid crystal display which typically comes with the computer 60, 

45 such as an Apple Macintosh, and a printer 68, such as the XL7700 Dye Sublimation Printer available from East- 
man Kodak Co. of Rochester, N.Y. The display 66 is calibrated using a calibration unit 70 which includes a low 
cost light intensity or achromatic sensor such as described in the related CRT calibration unit application, using 
processes described in the related subtractive measurement and luminance measurement applications previ- 
ously mentioned which provide light intensity data for performing the processes of the present invention. The 

50 printer 68 is calibrated using the calibration unit 70 as a reflectometer by combining the unit 70 with an illumi- 
nator 72 illuminating a printed document 74 with a stable light source and an aperture/lens through which the 
unit 70 looks. The results produced by the present invention are preferably stored in a set of characterization 
and calibration tables, one table for each color, which can be part of a file that can be loaded into the computer 
60 depending upon the application (scanning, displaying or printing) being performed. 

55 Adaptive aim curve calibration for a scann r 62 is a simple case sine most devices exhibit lin ar additive 
characteristics as illustrated in Fig. 7 by the combined curve 80. The appropriate ratios of red, green and blue 
(RGB) required to achieve a true n utral gray at minimum densities (reflection or transmission) also holds at 
maximum densities; therefor, only one point on the tone curves must be examined. The seal s of the axes 
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used in describing the response of a device in this description are denominated in "counts*' which represents 
the digital value n eded to provide th desir d output. In the xample of Fig. 7 a reflectance from a document 
of 100% will produce an output by the scanner of 255 while a zero reflectance will produce a 0 output by the 
scanner. 

5 The effective tristimulus value of a scanned patch under a given iiluminant is given by the convolution: 

X = kyfP(X)p(X)r(X)x(X)1(X)dX (1) 
Y = kJP(X)p(X)g(X)y(X)1(X)dX (2) 
Z = kJP(X)p(X)b(X)z(X)1(X)dX (3) 
where p{k) is the spectral reflectance of the patch being scanned, P(X) is the scanning iiluminant spectral power 
10 distribution plus imager response to a 100% diffuse reflector, l(X) is a reference source spectral power distrib- 
ution, preferably D50, r{k), g(X), b(X) are the filter's spectral sensitivities, x(X),y(X), z{K) are the 1 931 CIE Color 
Matching 

Functions and k x , ky, k z are normalizing constants defined by: 
15 kx = JP(X)r(X)dX (4) 

^"/PWgOW.) (6) 
= JP(5i)b(X)dX (6) 

20 Given that a neutral gray patch of a particular target material has specific tristimulus values under the D50 
iiluminant: Xdso = k 1f = k 2 , Z^o ■ k 3 where k 1( k 2 and k 3 will vary depending on the paper used since each 
type of paper will have a different XYZ for white under the D50 iiluminant It is a simple matter to f ind three 
scaling constants such that: = C^X, Ydso = C 2 Y and Zdso = where C 1f C 2 and C3 are unnormalized 
scaling constants. Since we are dealing with relative colorimetry, these may be scaled by dividing each by the 

25 largest values of the triad using: A^/max^ ,C 2 ,C3), B=C 2 /max(C 1 ,C 2 ,C 3 ) and OCa/max^ ,C 2 ,C3) where A, 
B and C are normalized color balanced scaling constants. These color balanced scaling constants are prefer- 
ably stored in a header file associated with each transform. 

The scanner calibration procedure uses a calibration target 94 as illustrated in Fig. 8. The preferred target 
94 includes several (20) color patches 96 with patch density values which range from .05D to 1.95D, Status A 

30 Density, D50 iiluminant. The test target 94 also includes fiducial marks 98 for orientation and a position location 
patch 99. The target is a monochrome (black and white) target and is used for all three scanner channels si- 
multaneously. The scanner will separate the target into three different color targets via the scanning process. 
Several conventional printing technologies exist which can be used to satisfy target requirements including pho- 
tographic replication, halftone printing and spot color printing. Each printing technique has both positive and 

35 negative characteristics such as manufacturing cost, target durability, replication tolerance and production vol- 
umes weigh heavily in the selection decision. For the highest possible calibration accuracy, the target should 
be fabricated on the same paper stock that the material to be scanned is printed on. Otherwise, any of the 
above mentioned printing technologies may be utilized successfully, but the optimal choice is the one most 
cost effective within specification constraints. Overall calibration accuracy is largely dependent on accurate 

40 knowledge of target patch characteristics. Two philosophies exist which address this concern. The f irst is to 
print highly precise targets and store the nominal patch values in the calibration software. The other is to print 
low precision targets, measure each target or perhaps each batch and then ship actual patch values with each 
target. Manufacturing studies have shown that printing high precision targets is the most cost effective pro- 
duction method; therefore, this is the preferred method selected for implementation. 

45 After the target is placed 102 on the scanner 62 by the user, as illustrated in Fig. 9, the next step in the 
calibration procedure is to acquire 104 the calibration target electronically after being scanned by the device 
to be calibrated. This is executed by placing a target as illustrated in Fig. 8 on the scanner's platen followed 
by invoking an acquisition sequence. Most scanners, including the preferred scanner, have included with the 
hardware a conventional application which performs automatic device control, data acquisition and storage 

50 tasks after a particular command is entered in the computer 60. The resulting color digital data is stored 106 
in a target file in a standard bit-mapped oriented file format-such as TIFF, PICT or EPS - in order for data ex- 
traction to occur. 

The target file is then opened 108 from within a color management calibration application or routine which 
automatically renders the scanned version of the target on the computer's monitor. The rendered version is 
55 rendered in calibrated form using the method for displays to b described later herein. Visual verification 110 
is perform d to check for gross errors in the acquisition process. Major defects such as missing pixels, exces- 
sive flair or inadvertent target cropping should be easily notic d by even novice us rs which must result in a 
rescan since th data is too contaminated to utilize. 



6 



EP 0 562 971 A1 



Target orientation is checked 112 next by noting the location of the position locating patch. This patch 
should be located at the top, I ft-hand corner of the rendered image wh n all t xt is directly readable. Con- 
ventional image rotation tools can be used to ori nt 114 the image correctly. Th se tools are available in most 
drawing packag s and some scanner control applications. Image resizing may be required if the resolution is 
5 too high. Ideally, the image should be scanned in at 100 to 150 dots per inch (DPI) for the patches to be of 
sufficient size for the extraction process. Conventional tools to perform image resizing are also available in 
most drawing packages, however, care must be applied in selecting an interpolation technique. Multi-pixel al- 
gorithms, such as bi- linear or bi-cubic interpolation, tend to yield erroneous results due to curve fitting errors 
and should be avoided. A nearest neighbor interpolator gives excellent results and is preferred. The file is then 

10 stored in bit-map form for subsequent processing and then closed 116. 

Acalibration process is then is invoked 118, as illustrated in Fig. 9, through a user entered command from 
within the application. Command attributes include the file name of the visually validated calibration target and 
the file name of the patch values corresponding to the scanner device being calibrated. The calibration proc- 
essing is the performed 120 as illustrated in Fig. 10. 

is In the first step in the calibration process the target file is opened 132 in a full frame buffer located within 
the calibration application. Asubsampled version of the image may be optionally displayed on the monitor for 
file verification purposes, but is not required. 

Fiducial marks locations are determined 134 by scanning the bit-mapped data for their unique "V shaped 
pattern. Once each point is accurately located, the relative displacement between them is calculated 136 in 

20 terms of delta X and delta Y on a Cartesian Coordinate system. This information is used to conventionally scale 
1 38 a pre-stored target map, so that the spatial resolution and rotation of the map matches that of the scanned 
target. A patch counter is then initialized 140. 

The map pinpoints 142 each patch center in absolute displacement from the two fiducial marks. Data ex- 
traction sequentially occurs on a patch by patch basis by examining 144 a 10 by 10 pixel region about each 

25 center point of each patch as defined by the target map. Each 100 pixel group is averaged 146 and the Root 
Mean Square (RMS) error is calculated from that average. The RGB averages are temporarily stored while 
the RMS error is checked against a maximum threshold. Exceeding the threshold indicates either excessive 
scanner noise or inappropriate target resolution has occurred. A user warning is preferably posted to alert the 
user of the situation. Target re-acquisition is advised, but not necessary. The patch counter is tested 148 and 

30 incremented as necessary until all patch data has been extracted and averaged. 

The scaling constants previously discussed are then retrieved 152 from the transform headerf iie and are 
used as a reference in the color balance calculations. As illustrated in Fig. 11, the most negative normalized 
RGB value 184 for a midscale patch as measured 154 from its scaling constant becomes 156 the fixed data 
point from which all subsequent calculations are made. It is important to note that in a conventional normali- 

35 zation operation the maximum coupled value is scaled to the maximum scale value and other values are scaled 
proportionately. That is, the normalized RGB triad calculated R at 255, G at 255 and B at 255 and scaled to 
unity. The reason that the values here are not at one is because a midscale triad whose values are less than 
one by definition has been chosen as the point for scaling the entire curve. Step 154 removes the channel 
saturation effects and maximizes aim curve scaling for full dynamic range. If one channel prematurely satur- 

40 ates, the normalized data value at the saturation point is used instead of the maximum patch value. This sub- 
stitution removes the channel saturation effects which would show up as non- achromatic highlights in a scan- 
ned image. The overall attenuation is calculated from the ratio of Bn and C. The overall attenuation is a scaling 
factor applied to two of the three scaling constants to generate new scaled aim curves. The overall attenuation 
is applied to the remaining two scaling constants, A and B yielding Raim and Gaim, in this example. An attenu- 

45 ation factor is then calculated 1 58 which brings the normalized red and green channel down to their respective 
aim values where Overall Attenuation = Bn/C, Bairn = B n , Gaim = GnBn/C, Raim=RnBn/C, Green Attenuation 
= (Gn/B)*Overall Attenuation and Red Attenuation = (Rn/A)*Overall Attenuation. Applying these scaling factors 
to or multiplying the unbalanced aim curves by these scaling factors yields the color balanced aim curves il- 
lustrated in Fig. 12. Note that the blue channel 210 is left unattenuated while the two remaining channels 212 

50 and 214 are appropriately scaled. Correction table creation is performed 160 by simply rotating the extracted 
patch or characterization data for each color about t heir respective aim curves and conventionally interpolating 
between the points providing channel independent linearization. The related application on automatic calibra- 
tion shows the rotating operation. Tables as illustrated graphically by the curves 220, 222 and 224 in Fig. 13 
result These curv s 220, 222 and 224 are th transforms which simultaneously accomplish the four objectives 

55 previously discussed. During use digital valu s for the color of each pixel in an image produced by the scanner 
(counts in) are transform d into correct d digital values (counts out) using a conventional table look up op r- 
ation. 

Monitor 66 calibration closely follows the procedure setforth above for input devices since pertinent device 
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behavior parall Is those of the flatbed scann r 62. This device class also may be represented by an additive 
model to an excel! nt approximation, but the primary responses are not linear with excitation as it was with 
the scanners. The gun transfer functions between the video signals and the electron beams are conventionally 
modeled as: 

r = Mr L ," riv l vaiue , T (7) 



G = k1g 



B = k1b 



^Maximum Counts 

f Drive Value 
Maximum Counts + k 2 

Drive Value 



(8) 



(9) 



i Maximum Counts + k 2b j 
rive value falls between 0 and maximum counts. 
As illustrated in Fig. 14, the typical monitor exhibits a distinct power function as predicted by the gun trans- 
fer function above when each primary's response is measured independently with a photometer. In Fig. 14 the 
vertical axis represents the cubic root of luminance (Cap Y). The curves 230, 232 and 234 are generated by 
measuring the luminance of each channel independently as a function of counts, preferably as described in 
the subtractive measurement application previously mentioned, and plotting Y 1 ' 3 as a function of counts. Note 
that for reasons to be discussed shortly, the ordinate is not a linear function, but rather a cubic root function. 
This causes the apparent y to be less than one when in reality, y s 2.2. These functions model the most unstable 
portion of a practical device which tends to drift with time and temperature. Since this phenomenon is not gun 
interdependent, it may be corrected using the variable aim curve approach discussed herein. 

The remaining portion of the classic monitor model is given by a conventional 3 by 3 matrix which simply 
performs a "rotation" between the RGB gun responses above and measurable tristimulus values, that is, equa- 
tion 10 below is the transfer function from the electron beam collision with the monitor phosphors the measured 
tristimulus values. This matrix is strictly a linear combination of constants which corresponds to RGB to XYZ 
conversion combined with a color cross- talk matrix which does not affect channel linearity. The physical in- 
terpretation of the cross-talk matrix is that it models the phosphor spectral emission characteristics which tend 
to exhibit long term stability, to an excellent, approximation. Calibration using the entirety of this model does 
not make sense, because expensive colorimetry instrumentation is required to measure the phosphor char- 
acteristics and because of the instrument limitations of the preferred monochrome, achromatic sensor. 



35 



40 



x r max X g max *b max 



max *g max *b max 



z r max Z g max Z b 



max 



R 
G 
B 



(10) 



45 The scaling constants for monitors are derived by a procedure that closely follows the procedure developed 
for scanners. Step one involves measuring the tristimulus values of the primaries by colorimetric measurement, 
using a colorimeter such as, the Minolta CRT color analyzer CA-100 at one point on the tone scale, usually at 
full scale. Other points could be chosen as well since monitor devices theoretically demonstrate phosphor con- 
sistency (phosphor chromatic rties do not vary with emission level), but measurements below full scale are typ- 

50 ically questionable due to instrumentation limitations. Such limitations can be overcome by using the subtrac- 
tive measurement technique described in the related application. Then, given that the measurements are re- 
lated to the phosphor emissrvity by a convolution as follows: 

X = kJ[r(X) + g(X) + b(X)]x(W^ (11) 
Y=kf[r(X) + g(X) + b(X)]y(X)dX (12) 
55 Z = kf [r{X) + + b(X)]z(X)dX. (1 3) 

where r[X),g{X),b{k) are phosphor pow r spectral densities, x(X),y(X),z(X) are the 1931 CIE Color Matching 
Functions and k is a normalizing constant defined by: 
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" J[r(X)-Hg(X) + b(X)]y(X)dX ; 
and that the target values to achiev a n utral gray scale are: Xqso = k 1( Y D50 ■ k 2 and Zq^ = k 3 . 
Scaling factors can be found that such that: 
5 Xpso = k J[CorW + C^X) + C 2 b(X)]x(X)dX (1 5) 

Yoso = k ftCrfX) + dg(X) + C 2 b(X)]y(X)dX (16) 
Zpso = k J[Cor(X) + dg(X) + C2b(X)]z(X)dX (1 7) 
where C 0 , d and Cj are unnormalized scaling factors. Since we are dealing with relative colorimetry, these 
may be scaled by dividing each by the largest values of the triad using A=Co/max(C 0 ,C 1f C2), 
10 B=C 1 /max(C 0 ,C 1 ,C 2 ) and C=C2/max{O 0 ,C^ ,0^ where A, B and C are normalized color balance constants. The 
constants are stored in the header file associated with each transform. 

The above technique involves determining the scaling constants using a colorimeter as the calibration in- 
strument. However, the scaling constants can be determined using the preferred achromatic sensors as dis- 
cussed below. 

15 A monitor is a linear additive device such that the white spectral power density is the sum of the three 
primary spectral densities 

w(X) = r(X) + b(X) + g(X) (18) 
When a colorimeter is used to measure a white patch on a monitor the results are found by convolving the 
color matching functions with the spectral power density of the patch to find normalized X, Y and 2 using equa- 

20 tions (11)-(14). This shows that the measurements made by a colorimeter, the X, Y and Z, values are integrals 
of the convolved curves. An achromatic measurement device, such as the preferred sensor, cannot generate 
the three values from a white patch measurement. The achromatic sensor can measure the response of each 
primary if the primary is displayed and measured independently. The three measurements are not related to 
the tristimuius values because the bandpass functions do not match those of the color matching functions. 

25 The measurements are calculated using a convolution as done for a colorimeter but the equations change to 
reflect the spectral "taking" characteristics of the achromatic sensor. The monitor primaries have an effective 
power spectral density of: 

B = b(X)f(X) (19) 
G = g(X)f(X) (20) 

30 R = r(X)f(X) (21) 

where f(X) is the spectral response of the achromatic sensor. 

Since the spectral characteristics differ between the two measurements a calibration of the colorimeter 
to the achromatic sensor must occur which results in unnormalized scaling factors. 

To obtain the scaling constants we must know X, Y and Z and some function of R(X), G(X) and B(X) where 
35 R(X), G(X) and B(X) are the convolutions of phosphor power density functions; r(X), g(X) and b(X) and f(X) the 
achromatic spectral response of the sensor as given in equations (19)-(21). Integrating each sum in equations 
(15)-(17)gives: 

X = kCjR(X)x(X)dX + kCjG(X)x(X)dX + KC 2 fB(X)x(X)dX (22) 
Y = KCjR(X)y(X)dX + kCjG(X)y(X)dX + KCjB^y^dX (23) 
40 Z = kCjR(X)z(X)dX + kCjG(X)z(X)dX + KCjB(X)z(X)dX (24) 

All of the variables of the integrations above are known for a monitor of a specific type and an achromatic meas- 
urement device, such as the preferred sensor. A single grey patch (R=G=B=255) can be selected to evaluate. 
Two evaluation procedures are available the first is a calculation method and the second is a measurement 
method. 

45 In the first calculation procedure the first step is to calculate X, Y and Z for a white point (R=G=B=255) by 

substituting phosphor spectral densities and color matching functions into equations (11)-(13) so that the rel- 
ative peak between b(X), g(X) and r(X) is preserved. Next the values forX, Yand Z are substituted into equations 
(22)-(24) and the integrals are calculated using the spectral densities of the phosphors, color matching func- 
tions and the achromatic sensor. Equations (22)-(24) are solved using conventional linear algebra methods 

so and the constants C 0 , and C2 are normalized. These constants are then provided as part of the calibration 
package with the monitor. 

The second method, at the factory, first measures, at the factory, the X, Y and Z for the white point 
(R=G=B=255) using the colorimeter previously mentioned and provides the values to the user as part of the 
calibration software. The values are substituted into equations (22)-(24). The response of the achromatic sen- 
55 sor is m asured separat ly by the user using color patches for red (R=255), blue (B=255) and green (G=255). 
The results are substituted into equations (22)- (24). The value k is s t at 1 and the constants are solved for 
as discussed previously. The constants C 0 , and C2 are then normalized and stored in the calibration soft- 
ware. In this method the achromatic sensor calibrated against th colorimeter on particular display type al- 
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lowing the achromatic sensor to be used on all displays of the same type. That is, the user measures red blue 
and green patches and the software does the calculations discussed above using the X, Y and Z values loaded 
into the equations at the factory. Of course th us r could measure the X, Y and 2 values if desired when the 
monitor is purchased and load the values into the software. 

The monitor calibration procedure, as illustrated in Fig. 15, begins by opening 242 the color management 
calibration application followed by the selection of the monitor calibration routine under the application This 
routine requires the naming of the appropriate device color profile (file name) for the monitor to be calibrated 

A circular target for calibrator placement is displayed 244 on the monitor after the file is successfully found 
The user is instructed, via a monitor displayed prompt, to place the calibrator unit 70 in the center of the circular 
target and press the unit 70 firmly against the CRT tube face. A built-in suction cup on the calibrator unit creates 
sufficient vacuum to hold the measurement device against the tube face for the duration of the measurement 
The user is also instructed to press a specific key to initiate 246 software controlled patch generation and data 
acquisition and calibration 248, discussed in more detail with respect to Fig. 16 and then the calibrator unit 70 
is removed 250. 

In the calibration operation of Fig. 16 a sequence of color targets are conventionally generated and dis- 
played which allows the calibrator unit 70 to measure each gun's "gamma" curve and the combined gray curve 
The measurement sequence requires measurement of a red curve from 0 to maximum input value, for example 
at every other value, measurement of the green curve, measurement of the blue curve and measurement of 
a combined curve where R G and B input values are equal. A patch counter is initialized 272 where the patch 
counter corresponds to the intensity of the color being measured. Each target is first rendered 274 in video 
memory which automatically causes it to be displayed 274 on the monitor. A wait period for monitor settling on 
the order of several refresh fields is provided 276 and then the calibrator is commanded 278 to capture data 
and transmit the results to the computer 60. Each target preferably has a near 50% gray background containing 
a central circular patch whose monochrome or color intensities are varied in accordance with a predefined se- 
quence. This sequence generates a conventional gamma curve whose quantization is equally spaced in device 
RGB space by providing different intensity monitor drive values (counts) for each patch which is measured by 
the unit 70 for the corresponding light intensity output for the input drive value. Experience has shown that a 
minimum of three values are required if each curve is to be modeled using the idealized relationship in equa- 
tions (7)-(9) during correction table generation, while approximately 32 are required if the data points are to 
ublized in an interpolation procedure. A complete scale of 0- 255 points can be taken if desired which gives 
the best results if the instrumentation is capable of recording low luminance data accurately a reason the sub- 
tractive technique of the related application is preferred. A partial scale created by measuring for every other 
code value is a compromise between speed and accuracy. 

Once the data is captured the scaling constants are then retrieved 284 from the transform selected by 
the user. All constants are located in the header file. 

Generation of the attenuation factors discussed previously, D50 balanced aim curves and the correction 
tables follow the procedure discussed previously for scanners, thus steps 286-294 will not be discussed in de- 
tail. There are some important differences, however, that must be discussed. The first and foremost is the 
choice of "linearization space". As discussed previously, the gamma curves are measured using a photometric 
(light intensity measurement) device and the results are numerically altered via a cubic root function as dis- 
cussed with respect to steps 152-162 of Fig. 11. This post processing is specifically instituted to minimize sys- 
tem errors when the calibration tables are cascaded with the characterization transform during color correction 
calibration. Other spaces could have been chosen without loss of generality. This choice does influence the 
balanced aim curves generated as illustrated in Fig. 17 because the vertical scales change. The correction 
tables produced as depicted graphically in Fig. 18 also change shape if a different space is chosen. 

Applying the present invention to printers can become complicated due to the inherent non- additive re- 
sponse of such devices. Prediction of color balance corrections to achieve a true neutral across a gray step 
wedge generally requires that the balance parameters be recalculated at each data point for the highest pos- 
sible accuracy. Since the goal is to simply return the device to a known operating condition, true gray scale 
preservation is not required and the color balance calculations may be performed at one point This first order 
approximation is subsequently corrected by the characterization process. 

This printer device class usually does not lend itself to precise analytical modeling which does not permit 
concise justification of the calibration process. Most printers, especially the ink and wax transfer devices are 
best modeled utilizing a polynomial approach, since ink lay down characteristics are complicated to model If 
the assumption is made that the ink's or dye's r lative spectral characteristics vary only slightly and that the 
absolute lay down shows a high degree of variance b tween print ngines and media/ink batches, then con- 
strained channel ind pendent calibration is possible. These assumptions are not 100% accurate, but xperi- 
ence has indicated that the assumptions are a very good approximation to real world anomalies. 
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The tone curv s for a typical dy sublimation printer are reproduced in Fig. 19. Note that all three colorants 
330, 332, 334 appear to track as xp cted (r quired to achieve a gray scale) and that the thr e scales saturate 
near 100% RGB reflectance (or equivalentty, near 0% CMY refi ctance). Scaling the tone scale responses at 
one point is sufficient to achieve the desired color balance to a first order approximation. Channel saturation 
5 effects shown here do affect choice of balance point - obviously maximum scale is not appropriate. A mid- 
scale data point yields a good result Given that only a single point is utilized, these saturation effects will not 
be compensated for and hue shift will occur. Fortunately, saturation occurs in the black region where the eye 
is not hue sensitive, so the effect may be ignored with little impact on overall image quality. 

Assuming a single balance point near mid- tone scale, the scaling constants are derived as follows. The 
10 CMY printer's (or RGB printer's) tristimulus response can be simply modeled to a first order approximation as: 

X = kJ[r(X) + g(X) + b(X)]x(X)p(X)P(X)dX (25) 
Y = kf[r(X) + g(X) + b(X)]y(X)p(X)P(X)6X (26) 
Z = kftrM + g[X) + b(X)]z(X)p(X)P(X)dX (27) 
where r(X), q(X), b(X) are printed patch spectral reflection densities associated with RGB channels, x(X), y(X), 
15 z(X) are the 1 931 CIE color matching Functions, p(X) is the viewing source spectral power distribution preferably 
D50, P(X) is measurement device spectral response, and k is a normalizing constant defined by: 



JMM + Q(X) + b(X)]y(X)p(X)P(X)6X V ' 
and that the target values to achieve a neutral gray scale are the paper white tristimulus under D50: 
20 X050 = ki, Ydso = k 2 and 2.^o = k3. 

Scaling factors can be found that such that: 

Xoso = k J[Cor(X) + C^(X) + C 2 b(X)]x(X)6X (29) 
Ydso = k J[C(>r(X) + dg(X) + C 2 b(X)]y(X)dX (30) 
Zoso = K i[Cor(X) + dg(X) + C2b(X)]zMdX (31) 
25 where C 0 , d and C 2 are unnormalized scaling factors. Since we are dealing with relative colorimetry, these 
may be scaled by dividing each by the largest values of the triad using: A=C 0 /max(Co,C 1 ,C2), 
B^/maxfCoA.CJ and C=C 2 /max(Co,C 1l C2) where A, B and C are normalized color balanced scaling con- 
stants. 

The printer calibration procedure is illustrated in Fig. 20. Commercial spectrophotometers or densitometers 

30 may be used for tone scale measurement, but are extremely high in cost. The approach preferred involves using 
the monitor calibrator unit 70 with a stable illuminator 72 to enable measurement of relative reflectances. 

The calibration procedure begins by opening 342 the color management calibration application followed 
by the selection of the printer calibration routine under the application. This routine requires the naming of the 
appropriate device color profile file for the printer to be calibrated. 

35 The gray scale target is rendered 344 in memory and the resulting bit-map is down loaded to the printer. 
A high level graphics language could be utilized instead, but some printers do not contain the Raster Image 
Processors (RIPs) required to render the image in the printer. The target is identical to the gray scale target 
in Fig. 8 except that it exists as an electronic file. 

The user then presses a key to initiate 346 a software controlled data acquisition. A patch counter is ini- 

40 tialized 348 and the count value corresponds to the intensity of a particular color curve being measured. In- 
teractive responses should be used to synchronize measurements with the appropriate patch number. The user 
must place 350 the reflectance measurement device over each patch in succession and press 352 a key to 
indicate set-up readiness. The application instructs the unit 70 to acquire reflectance data and return the results 
to the computer 60. Patch measurement order is unique and specific for this target so no deviation is permitted. 

45 User prompts on the monitor provide "next patch" information to prevent sequential measurement errors until 
a test 354 indicates that all patches have been measured. Otherwise the patch pointer is incremented 356. 
Once the density of all the patches for all the colors have been measured the calibration routine of Fig. 21 is 
performed 358. 

Generation of the attenuation factors, D50 balanced aim curves and the correction tables follows the pro- 
so cedure previously discussed for scanners, thus steps 370-382 of Fig. 21 will not be discussed in detail. There 
are some important differences; however, that must be discussed. The first and foremost is the choice of "lin- 
earization space". As discussed previously, the tones are measured using a photometric device and a light 
source, and the results are numerically altered via a cubic root of reflection function. This post processing is 
specifically instituted to minimize syst m errors when the calibration tables are cascaded with the character- 
55 ization transform. Other spaces could have been chosen without loss of gen rality. This choice does influence 
the balanced aim curves gen rated and illustrated in Fig. 22. The correction table shapes are also affected, 
the results for this example are given in Fig. 23. 

Once the particular combined characterization, balanced aim calibration corr ction, scaling correction and 
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saturation correction table has been created for a particular device, such as the printer 68, monitor 66 or scan- 
ner 62 of Fig. 6, the table is stor d in a file in th nonvolatile storage of the computer 60, such as the hard 
disk. When a particular operation needing the transform is required the table is loaded and used. For example, 
if a document to be scanned is loaded into the scanner, as the pixel input values are received from the scanner 

5 the scanner table is used, in a conventional table look- up operation, to convert the pixel values to pixel values 
in the color space desired for further processing. Once the processing of the image is complete as the pixels 
for output are sent to the monitor memory or the printer memory for display or printing the pixels are trans- 
formed using the appropriate monitor and/or printer tables. As a result, the scanned, displayed and printed im- 
age will visually appear identical. 

10 The many features and advantages of the invention are apparent from the detailed specification and thus 
it is intended by the appended claims to coverall such features and advantages of the invention which fall within 
the true spirit and scope of the invention. Further, since numerous modifications and changes will readily occur 
to those skilled in the art, it is not desired to limitthe invention to the exact construction and operation illustrated 
and described, and accordingly all suitable modifications and equivalents may be resorted to, falling within the 

15 scope of the invention. 



Claims 

20 1. An apparatus for color device calibration, comprising: 

intensity measurement means for separately measuring intensity characterization curves of color 
channels of the color device; and 

calibration means for creating calibration curves for producing a white point balanced response by 
the device responsive to the characterization curves. 

25 

2. An apparatus as recited in claim 1 , wherein said calibration means creates said calibration curves by ro- 
tating the characterization curves about linear aim curves having a balanced white point. 
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3. An apparatus as recited in claim 1 , wherein said calibration means scales the calibration curves to a sat- 
uration value. 

4. An apparatus as recited in claim 1, wherein said calibration means normalizes to a one of the character- 
ization curves having a most negative maximum response when compared to a corresponding aim curve. 

5. An apparatus as recited in claim 1, wherein said calibration means comprises: 
constant means for determining normalized color balanced scaling constants; 
normalization means for normalizing the characterization curves to a maximum response; 
balance constant means for determining curve balance constants using the scaling constants; 
balance curve scaling means for scaling aim curves with the curve balance constants; and 
balanced curve creation means for creating correction tables by rotating the characterization 

curves about the scaled aim curves. 

6. An apparatus as recited in claim 1 , wherein said apparatus operates with a monitor, a printer and a scanner. 

7. An apparatus as recited in claim 1 , wherein said intensity means comprises an achromatic light sensor. 

45 

8. An apparatus as recited in claim 1 , wherein said calibration means comprises a computer. 

9. An apparatus for monitor, printer and scanner calibration, comprising: 

an achromatic light sensor separately and achromatically measuring intensity characterization 
curves of color channels of the color device; and 

a computer creating calibration curves for producing a white point balanced response by the device 
responsive to the characterization curves, said computer comprising: 

constant means for determining normalized color balanced scaling constants; 
normalization means for normalizing the characterization curves to a maximum response; 
55 balance constant m ans for determining curve balance constants using the scaling con- 

stants; 

balance curve scaling means for scaling aim curves with the curve balance constants; and 
balanced curve creation means for creating correction tables by rotating the characterization 



50 



12 



EP 0 562 971 A1 



10 



15 



curves about the scaled aim curves. 

10. A method of calibrating a desk top computer color device, comprising the steps of: 

(a) controlling the color device to produce color characterization curves of a color response of the de- 
vice; and 

(b) adaptively producing color balanced calibration tables from the characterization curves. 

11. A method as recited in claim 1 0, wherein step (b) comprises: 
(b1) determining scaling constants; 

(b2) normalizing the characterization curves for a maximum device dynamic range compensating for 
saturation; 

(b3) determining a most negative normalized response; 

(b4) determining color balance constants from the most negative normalized response; 
(b5) scaling aim curves using the color balance constants; and 

(b6) creating the calibration tables using the scaled aim curves and the normalized characterization 
curves. 

12. A method as recited in claim 10, wherein said method is initiated by a user of the desk top computer. 

13. A method as recited in claim 10, wherein said characterization curves of step (a) are first, second and 
20 third different color curves. 

14. A method as recited in claim 10, wherein step (b) comprises producing the color balanced calibration 
curves using a color balanced tricolor aim curve. 

25 15. A method as recited in claim 10, wherein step (a) includes a producing an RMS average for a group of 
pixels for each point on the characterization curves. 

16. A method of calibrating a desk top computer color device, comprising the steps of. 

(a) controlling, upon initiation of a user, the color device to produce color three characterization curves 
30 of a tricolor response of the device; and 

(b) adaptively producing three color balanced calibration tables from the characterization curves, com- 
prising the steps of: 

(b1) determining scaling constants; 

(b2) normalizing the characterization curves for a maximum device dynamic range compensating 
35 for saturation; 

(b3) determining a most negative normalized response; 

(b4) determining color balance constants from the most negative normalized response; 
(b5) scaling aim curves using the color balance constants; and 

(b6) creating the calibration tables using the scaled aim curves and the normalized characterization 
40 curves. 

17. A method of creating color calibration tables from response characterization values produced by a color 
input/output device, comprising the steps of: 

(a) normalizing the characterization values; 
45 (b) determining color balanced aim curves from the characterization values; and 

(c) producing the color calibration tables using the balanced aim curves and the characterization val- 
ues. 
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18. A method as recited in claim 17, further comprising (d) compensating for saturated channel response by 
scaling the aim curves. 

19. A method as recited in claim 17, wherein the balanced aim curves are linear. 

20. A method as recited in claim 17, wherein the balanced aim curves are nonlinear. 
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